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JEAN B. LASSERRE 



Abstract. We show that every real nonnegative polynomial / can be 
approximated as closely as desired by a sequence of polynomials {f^} 
that are sums of squares. Each /e has a simple et explicit form in 
terms of / and e. A special representation is also obtained for convex 
polynomials, nonnegative on a convex semi-algebraic set. 



1. Introduction 

The study of relationships between nonnegative and sums of squares 
(s.o.s.) polynomials, initiated by Hilbert, is of real practical importance 
in view of numerous potential applications, notably in polynomial program- 
ming. Indeed, checking whether a given polynomial is nonnegative is a 
NP-hard problem whereas checking it is s.o.s. reduces to solving a (convex) 
Semidefinite Programming (SDP) problem for which efficient algorithms are 
now available. For instance, recent results in real algebraic geometry, most 
notably by Schmiidgen jT^], Putinar ^2|, Jacobi and Prestel have pro- 
vided s.o.s. representations of polynomials, positive on a compact semial- 
gebraic set; the interested reader is referred to Prestel and Delzell [IV and 
Scheiderer |14j for a nice account of such results. This in turn has permit- 
ted to develop efficient SDP-relaxations in polynomial optimization (see e.g. 
Lasserre El EI > Parrilo [HI El , Schweighofer , and the many references 
therein). 

So, back to a comparison between nonnegative and s.o.s. polynomials, 
on the negative side, Blekherman |2| has shown that if the degree is fixed, 
then the cone of nonnegative polynomials is much larger than that of s.o.s. 
However, on the positive side, a denseness result PI states that the cone of 
s.o.s. polynomials is dense in the space of polynomials that are nonnegative 
on [—1, !]"■ (for the norm ||/||i = \ fa\ whenever / is written fax'^ in 
the usual canonical basis); see e.g. Berg ^ Theorem 5, p. 117]). 

Contribution. We show that every nonnegative polynomial / is almost 
a s.o.s., namely we show that / can be approximated by a sequence of s.o.s. 
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polynomials {fe}e, in the specific form 

(1-1) ^ = / + ^EEir' 

k=0 j=l 

for some G N, so that ||/ — f^\\i ^ as e | 0. 

This result is in the spirit of the previous denseness result. However 
we here provide in an explicit converging approximation with a very 

specific (and simple) form; namely it suffices to slightly perturbate / by 
adding a small coefficient e > to each square monomial xf'^ for all i = 
1, . . . ,n and all A: = 1, . . . , r, with r sufficiently large. 

To prove this result we combine 

- (generalized) Carleman's sufficient condition for a moment sequence 
y = {Ua} to have a representing measure (i.e., such that i/a = J x^dfi for 
ah a e N"), and 

- a duality result from convex optimization. 

As a consequence, we may thus define a procedure to approximate the 
global minimum of a polynomial /. It consists in solving a sequence of 
SDP-relaxations which are simpler and easier to solve than those defined in 
Lasserre [H]. Finally, we also consider the case where / is a convex poly- 
nomial, nonnegative on a convex semi-algebraic set K defined by (concave 
polynomial) inequalities gj > 0. We show that the approximation of /, 
defined in has a certificate of positivity on K (or a representation) 

similar to Putinar's s.o.s. representation [T^, but in which the s.o.s. poly- 
nomial coefficients of the gj^s now become simple nonnegative scalars, the 
Lagrange multipliers of a related convex optimization problem. 

2. Notation and definitions 

For a real symmetric matrix A, the notation ^4 ^ (resp. ^ ;^ 0) stands 
for A positive semidefinite (resp. positive definite). The sup-norm supj \xj\ 
of a vector x E M", is denoted by ||x||oo- Let . . . ,Xn] be the ring of 

real polynomials, and let 

(2.1) Vr{x) := (1, Xi,X2,... Xn, X?, X1X2, • • • , X^, X2X3, ■ ■ ■ , X^^) 

be the canonical basis for the M-vector space Ar of real polynomials of 
degree at most r, and let s(r) be its dimension. Similarly, Uoo(x) denotes 
the canonical basis of M[ M-vector space, denoted A. So a 

vector in A has always finitely many zeros. 
Therefore, a polynomial p £ Ar is written 

X ^ p{x) = ^^PaX° = {p,Vr{x)), X E M", 

a 

(where x" = x^^Xg^ . . . x^") for some vector p = {pa} G M''^''\ the vector of 
coefficients of p in the basis (|2.1|) . 
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Extending p with zeros, we can also consider p as a vector indexed in the 
basis Voo{x) (i.e. p G A). If we equip A with the usual scalar product (., .) 
of vectors, then for every p ^ A, 

Pix) = PaX°' = {p,Voo{x)), xeM."-. 

o>eN" 

Given a sequence y = {ua} indexed in the basis ^00(2^)1 let Ly : ^ ^ M 
be the linear functional 

p^Ly{p) := J2 PaVa = (P,y)- 

Given a sequence y = {ua} indexed in the basis Voq{x), the moment matrix 
Mr{y) G M^Wx^W with rows and columns indexed in the basis Vr{x) in 
(|2.1j) . satisfies 

[M,(y)(l,i) = ya and M^(y)(i,l) = yp] Mr{y){i,j) = y^+f}- 
For instance, with n = 2, 



M2(y) = 



yoo 


yio 


yoi 


y2o 


yn 


yo2 


yio 


y2o 


yu 


yso 


y2i 


yi2 


yoi 


yu 


yo2 


y2i 


yi2 


2/03 


y2o 


yso 


y2i 


y4o 




2/22 


yii 


y2i 


yi2 


ysi 


^22 


2/13 


yo2 


yi2 


yo3 


2/22 


yi3 


2/04 



A sequence y = {2/0} has a representing measure fiy if 

(2.2) ya = [ x'^dfiy, Va e N". 

In this case one also says that y is a moment sequence. In addition, if fiy is 
unique then y is said to be a determinate moment sequence. 
The matrix Mj.(y) defines a bilinear form (., .)y on Ar, by 

{Q,P)y ■= (q,Afr(y)p) = Ly{qp), q,p e Ar, 
and if y has a representing measure ^y then 

(2.3) (q,M,(y)q) = / qixf fiyidx) > 0, 

SO that Mr{y) h 0. 

Next, given a sequence y = {ya} indexed in the basis ^00(3;), let ygl! '•— 
Ly{x'f^) for every i = 1, . . . ,n and every A: S N. That is, y^l denotes the 
element in the sequence y, corresponding to the monomial xf^ . 

Of course not every sequence y = {ya} has a representing measure /Xy 
as in (|2.2|) . However, there exists a sufficient condition to ensure that it is 
the case. The following result stated in Berg |2l Theorem 5, p. 117] is from 
Nussbaum |Hj, and is re-stated here, with our notation. 
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Theorem 2.1. Let y = {ua} be an infinite sequence such that Mr{y) >: 
for all r = 0,1,.... If 

oo 

(2-4) E(y2 = oo, ^ = l,...,n, 

then y is a determinate moment sequence. 

The condition H2.4() in Theorem 12.11 is called Carleman's condition as it 
extends to the multivariate case the original Carleman's sufficient condition 
given for the univariate case. 



3. Preliminaries 
Let Bm be the closed ball 

(3.1) BAf = {xGM"| ||x||oo < M}. 

Proposition 3.1. Let f G . . . be such that — oo < /* := inf^. f{x). 

Then, for every e > there is some G N such that 

fl, ■■= inf f{x) </* + €, VM > M,. 

x&Bm 

Equivalently, f^j If* as M ^ oo. 

Proof. Suppose it is false. That is, there is some eo > and an infinite 
sequence sequence {M^} C N, with oo, such that f^j^ > /* + eo for 

ah k. But let xq G M" be such that /(xq) < /* + eo. With any Mk > ||xo||oo, 
one obtains the contradiction /* + eo < fl,j^ < f{xo) < f* — eo- □ 

To prove our main result (Theorem 14.11 below), we first introduce the 
following related optimization problems. 

(3.2) P : r := inf^ fix), 
and for < M G N, 

(3.3) Vm : ^^inf^„^ | / / I / g e^? d;. < ne^^ | , 

where V{W^) is the space of probability measures on M". The respective 
optimal values of P and Vm are denoted inf P = /* and inf 'Pj\/, or niinP 
and minVM if the minimum is attained. 

Proposition 3.2. Let f G M[xi, . . . , x„] be such that — oo < /* := infj, f{x), 
and consider the two optimization problems P and Vm defined in / l^.i!)) and 
US. respectively. Then, miVM i f* as M ^ oo. If f has a global mini- 
mizer x* G M", then minVM = f* whenever M > ||x*||oo- 
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Proof. Let /x G V{W) be admissible for Vm- As / > /* on M" then it 
follows immediately that / fdfi > /*, and so, infVM > /* for all M. 

As Bm is closed and bounded, it is compact and so, with fp^ as in Propo- 
sition there is some x £ Bm such that /(£) = flj. In addition let 



fie 



be the Dirac probability measure at the point x. As 



< M, 



/n n 
1=1 i=l 



.(^0^ < ne^' 



so that fi is an admissible solution of Vm with value / f dfi = f{x) = f^.^, 
which proves that voIVm ^ Jm- This latter fact, combined with Proposition 
1,3. H and with /* < inf Vm-, implies inf Vm i /* as M — > oo, the desired result. 
The final statement is immediate by taking as feasible solution for Vm^ the 
Dirac probability measure at the point x* E Bm (with M > ||2;*||oo)- As 
its value is now /*, it is also optimal, and so, Vm is solvable with optimal 
value minT^M = /*• D 

Proposition K12I provides a rationale for introducing the following Semi- 
definite Programming (SDP) problems. Let 2r/ be the degree of / and for 
every rj < r G N, consider the SDP problem 



(3.4) 



min Ly(/) (= ^fcVc) 



s.t. M,(y) 

r n ii) 

\ ^ \ ^ 

k\ 

k=0 i=l 

yo 



^ 



< ne 



M2 



and its associated dual SDP problem 



(3.5) 



max 7 

A>0,7,g 



s.t. /-7 



T.2k 



k=Q j=l 

s.o.s. of degree < 2r, 



with respective optimal values inf Q,. and supQ* (or minQ^ and maxQ* if 
the optimum is attained, in which case the problems are said to be solvable). 
For more details on SDP theory, the interested reader is referred to the 
survey paper [T7] . 

The SDP problem Qr is a relaxation of Vm, and we next show that in 
fact 

- Qr is solvable for all r > vq, 

- its optimal value minQ^ — > inf "P^,/ as r ^ oo, and 

- Q* is also solvable with same optimal value as Qr, for every r > rj. 
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This latter fact will be crucial to prove our main result in the next section. 
Let loo (resp. h) be the Banach space of bounded (resp. summable) infinite 
sequences with the sup- norm (resp. the /i-norm). 

Theorem 3.3. Let / G M[ Xi, . . . , Xn] be of degree 2rj, with global minimum 
f* > — oo, and let M > be fixed. Then : 

(i) For every r > rj, is solvable, and minQ^ | voIVm as r ^ oo. 

(ii) Let y^^^ = {ya^} be an optimal solution of Qr and complete y^^^ with 
zeros to make it an element ofl^o- Every (pointwise) accumulation point y* 
of the sequence {y^''-'}reN ^ determinate moment sequence, that is, 

(3.6) y*c.= I x'^dfi*, a G N", 

for a unique probability measure fi* , and fi* is an optimal solution ofVM- 

(iii) For every r > rf, maxQ* = minQ^. 

For a proof see ^5.11 

So, one can approximate the optimal value /* of P as closely as desired, 
by solving SDP-relaxations {Qr} for sufficiently large values of r and M. 
Indeed, /* < iniVM < flj, with f^j as in Proposition 13.11 Therefore, let 
e > be fixed, arbitrary. By Proposition 13. 2( we have /* < inf Vm ^ /* + e 
provided that M is sufficiently large. Next, by Theorem I3.3r i). one has 
inf Qr > infVM — e provided that r is sufficiently large, in which case, we 
finally have f*-e< inf Qr < /* + e. 

Notice that the SDP-relaxation Q^ in (|3.4|) is simpler than the one defined 
in Lasserre 0. Both have the same variables y G M*'^^'-', but the former has 
one SDP constraint Mr(y) ^ and one scalar inequality (as one substitutes 
2/0 with 1) whereas the latter has the same SDP constraint Mr(y) ^ 
and one additional SDP constraint Mr_i(^y) ^ for the localizing matrix 
associated with the polynomial x ^ 6{x) = M"^ — ||x|p. This results in a 
significant simplification. 

4. Sum of squares approximation 
Let A be equipped with the norm 

/ ^ ll/lli := E f^^- 

Theorem 4.1. Let f G M[xi, . . . ,x„] be nonnegative with global minimum 
f* , that is, 

< f* < fix), X G M". 
(i) There is some G N, Aq > such that, for all r > tq and A > Aq, 

r n ^2k 

(4.1) / + A is a sum of squares. 

k=o j=l 
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(ii) For every e > 0, there is some E N such that, 

re n ^2k 

(4.2) fe-=f + ^ is a sum of squares. 

k=o j=l 

Hence, \\f — — > as e I 0. 

For a proof see ^5.21 

Remark 4.2. Theorem 14. ir ii) is a denseness result in the spirit of Theorem 
5 in Berg [21 p. 117] which states that the cone of s.o.s. polynomials is 
dense (also for the norm ||/||i) in the cone of polynomials that are nonneg- 
ative on [—1,1]*^. However, notice that Theorem I4.1f ii') provides an explicit 
converging sequence {/e} with a simple and very specific form. 

We next consider the case of a convex polynomial, nonnegative on a con- 
vex semi-algebraic set. Given {gj}Y=i C E.[xi, . . . let IK C M" be the 
semi-algebraic set 

(4.3) ]K:={xeM"| gjix)>0, j = l,...,m}. 

Corollary 4.3. Let IfC be as in j^.^ , where all the gj 's are concave, and 
assume that Slater's condition holds, i.e., there exists xq £ M. such that 
gj{xo) > for all j = 1,..., m. 

Let f G . . . ,Xn] be convex, nonnegative on K, and with a minimizer 

on K, that is, f{x*) < f{x) for all x G IfC, for some x* £ K. Then there 
exists a nonnegative vector A G M*" such that for every e > 0, there is some 

G N for which 

ft n 2k 

(4-4) / + ^EE^ = /o + E^.5.' 

fc=0 i=l i=i 

with /o G M[xi, . . . , Xn\ being a sum of squares. (Therefore, the degree of fo 
is less than max[2re, deg /, deg gi, . . . , deg gm] ■) 

Proof. Consider the convex optimization problem /* := min{/(x) | x G K}. 
As / is convex, K is a convex set and Slater's condition holds, the Karush- 
Kuhn- Tucker optimality condition holds. That is, there exists a nonnegative 
vector A G M"* of Lagrange-KKT multipliers, such that 

m 

V/(x*) = ^ A,V5,(x*); Xjgjix*) = 0, j = 1, . . . , m. 

(See e.g. Rockafellar JTT.) In other words, x* is also a (global) minimizer 
of the convex Lagrangian L := f — X^JLi ^jdj- Then /* = f{x*) = L{x*) is 
the (global) minimum of / on IK, as well as the global minimum of L on R", 
i.e., 

m 

(4.5) f -Y^Xjgj- f*>^, xGM". 
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As / > on K, /* > 0, and so L > on W'\ Then (gll) fohows from 
Theorem I4.ir ii). apphed to the polynomial L. □ 

When IK is compact (and so, / has necessarily a minimizer x* G K), one 
may compare Corollary 14.31 with Putinar's representation ^2] of polyno- 
mials, positive on IK. When / is nonnegative on IK (compact), and with 

A;=0 i=l 

one may rewrite (|4.4p as 

m 

(4.7) fe = fo + Y^Xjgj, 

i=i 

which is indeed a certificate of positivitity of on IK. In fact, as > 
on K, (|4.7j) can be seen as a special form of Putinar's s.o.s. representation, 
namely 

m 

(4.8) = go + ^ qj gj^ with go, • • • , «m s.o.s. 

j=i 

(which holds under an additional assumption on the 5j's). So, in the con- 
vex compact case, and under Slater's condition, Corollarv 14.31 states that if 
/ > on IK, then its approximation in (|4.6|) . has the simplified Putinar 
representation (|4.7|) . in which the s.o.s. coefficients {qj} of the gj's in (|4.8j) . 
become now simple nonnegative scalars in (|4.7|) . namely, the Lagrange-KKT 
multipliers {Aj}. 

5. Proofs 

5.1. Proof of Theorem 13.31 We will prove (i) and (ii) together. We first 
prove that Q,. is solvable. This is because the feasible set (which is closed) 
is compact. Indeed, the constraint 

±±yn/kl < ne-^ 

k=0 i=l 

implies that every diagonal element j/gfc of of Mr{y) is bounded by := 
nrle^^ . By Lemma l6.2| this in turn implies that its diagonal elements (i.e., 
y2a, with \a\ < r) are all bounded by r^. 

This latter fact and again Mr{y) >z 0, also imply that in fact ever?/ element 
of Mr{y) is bounded by r^, that is, \ya\ < Tr for all \a\ < 2r. Indeed, 
for a a symmetric matrix A ^ 0, every non diagonal element Aij satisfies 

Therefore the set of feasible solutions of is a closed bounded subset of 
M'*^''^ hence compact. As Ly{f) is linear in y, the infimum is attained at 
some feasible point. Thus, for all r > rj, is solvable with optimal value 



A SUM OF SQUARES APPROXIMATION OF NONNEGATIVE POLYNOMIALS 9 



minQr ^ infPjv/- The latter inequality is because the moment sequence 
y associated with an an arbitrary feasible solution fi of Vm, is obviously 
feasible for Q^, and with value Ly{f) = J fdfi. 

Next, as the sequence {minQ^jr is obviously monotone non decreasing, 
one has minQ^ T /O* < infPM! as r ^ oo. We have seen that every entry 
of Mr{y) is bounded by r^., and this bound holds for all r > rj. Moreover, 
Mr(y) is also a (north-west corner) submatrix of Ms{y) for every s > r. 
Indeed, whenever s > r, one may write 



M.(y) 



Mr{y) I B 
B' I C 



for some appropriate matrices B and C. Therefore, for the same reasons, 
any feasible solution y of Qs(y) satisfies \ya\ < Tr, for all a G such that 
|a| < 2r. Therefore, for every s G N, and every feasible solution y of Q^, we 
have 

\ya\<rr, Va G N", 2r - 1 < |q| < 2r, r=l,...,s. 

Thus, given y = {ua}, denote by y = {y^} the new sequence obtained from 
y by the scaling 

ya-=ya/rr Vo G N", 2r - 1 < |a| < 2r, r = l,2,... 

So let y^^-* = {ua^} be an optimal solution of and complete y*-^'-* with 
zeros to make it an element of loo- Hence, all the elements y^^^ are in the 
unit ball Bi of loo, defined by 

^1 = {y = {va} e ^oo I ||y||oo < i}- 

By the Banach-Alaoglu Theorem, this ball is sequentially compact in the 
(^{loo,h) (weak*) topology of loo (see e.g. Ash P). In other words, there 
exists an element y* G Bi and a subsequence {r^} C N, such that y^^^) — > y* 
for the weak* topology of loo, that is, for all u G li, 

(5.1) {y^'''\n) ^ (r,u), ask^oo. 

In particular, pointwise convergence holds, that is, for all a G N", 

Va'"^ y*a^ as /C ^ CX), 

and so, defining y* from y* by 

y*a = rrra, Vo G N", 2r - 1 < |a| < 2r, r = l,2,... 
one also obtains the pointwise convergence 

(5.2) for all a G N", y^^'^^ ^ y^, as A; ^ oo. 

We next prove that y* is the moment sequence of an optimal solution n* 
of problem Vm- From the pointwise convergence (|5.2|) . we immediately get 
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Mr{y*) ^ for all r > rj, because Mr{y) belongs to the cone of posi- 
tive semidefinite matrices of size s(r), which is closed. Next, and again by 
pointwise convergence, for every s G N, 

j=0 1=1 j=0 i=l 

and so, by the Monotone Convergence Theorem 

oo n s n 

(5-3) = ii- ^ 

j=0 i=l j=0 i=l 

But H5.3() implies that y* satisfies Carleman's condition H2.4() is satisfied. 
Indeed, from ()5.3() . for all i = 1, . . . , n, we have < pk\ for ah fc G N, 

and so, as k\ <k^ = \fk , 

which in turn implies 

°o -l/2fc 
fc=0 A:=0 ^ 

Hence, by Theorem 12. II y* is a determinate moment sequence, that is, there 
exists a unique measure p* on M", such that 

By (IS31), 



i=l j=0 i=l 

which proves that fi* is admissible for Vm- 

But then, again by the pointwise convergence (|5.2|) of y*-^'*^^ to y*, we get 
Lyirk){f) Ly'if) = I fdl^* as k ^ oo, which, in view of L^(r,,){f) < 
inf for all k, implies 



I fdfi* = Ly,{f) < mfVM. 



But this proves that fi* is an optimal solution of Vm because //* is admissible 
for Vm with value f fdfi* < \niVM- As the converging subsequence {r^} 
was arbitrary, it is true for every limit point. Hence, we have proved (i) and 
(ii). 

(iii) Let y be the moment sequence associated with the probability mea- 
sure /i on the ball 

Bm/2 = {y = {Va} G loo I ||y||oo < M/2}, 
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with uniform distribution. That is, 

^i{B) = Af-" / dx, B £ B, 

JBnBM/2 

where B is the sigma-algebra of Borel subsets of M". 

As /i has a continuous density > on i?Af/2) it follows easily that 
Mr{y) >- for all r > rj. In addition, 

i:i:^sa!< /x:e^?d^<ne^^ 

A:=0 i=l j=l 

SO that y is a strictly admissible solution for <Qr- Hence, the SDP problem 
Qr satisfies Slater's condition, and so, there is no duality gap between 
and Q*, and Q* is solvable if inf Q,. is finite; see e.g. Vandenberghe and 
Boyd 17 . Thus, Q* is solvable because we proved that is solvable. In 
other words, supQ* = maxQ* = minQ^, the desired result. □ 

5.2. Proof of Theorem 14. IL It suffices to prove (i) and (ii) for the case 
/* > 0. Indeed, if /* = take e > arbitrary, fixed. Then f + ne > f* = 
f*+ne>0 and so, suppose that (|4.1j) holds for f + ne (for some rg, Aq). In 
particular, pick A > Aq + e, so that 

k=o j=l 

(with qx S.O.S.), for rx > vq. Equivalently, 

r\ n 2k rx n 2k 

fc=0 j=l k=l j=l 

where qx is a s.o.s. Hence (|4.1() also holds for / (with Aq + e in lieu of Aq). 

Similarly, for (|^ . As /* = 0, / + ne > and so, suppose that 
holds for f + ne. In particular, 

Tt n ^2k 

/ + ne + e^J^-^ = q,, 

k=0 j=l 

(with s.o.s.) , for some r^. Equivalently, 

re n 2k r^ n 2k 

fc=Oj=l k=l j=l 

where q^ is a s.o.s. Hence ()4.2() also holds for /. Therefore, we will assume 
that /* > 0. 

(i) As /* > 0, let Mq be such that /* > 1/Mq, and fix M > Mq. Consider 
the SDP problem Q* defined in 1)3. 5|) . associated with M. By Proposition 
O /* < inf^Af. By Theorem El maxQ^ = minQ^ j inf^M > /*. 
Therefore, there exists some vm such that maxQ*^^ > /* — > 0. 
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That is, if {qm, ^m,1m) is an optimal solution of Q*j,^, then 7^/ — nAMe'^^ > 
f* - 1/M > 0. In addition, 

f - IM = QM - >^M^^^, 

k=0 j=l 

that we rewrite 

/ I'M n ^2k 

(5.4) / - (7A/ - nAMe^') = Qm + Am ne^' " E E TT 



k! 

k=0 j=l 



Equivalently, 



/ + Am E E = + nAMe^ + (7M - nAne^ ). 

A; = j = l 



Define qm to be the s.o.s. polynomial 

QM ■■= QM + n\Me^^ + (7M - nAjvie'^^), 

so that we obtain 



(5.5) z + '^MEEir = 

k=0 j=l 

the desired result. 

If we now take r > tm and A > Aa/ we also have 

r n 2k tm n 2k 

fc=0 j=l k=0 j=l 

r n 2k r n 2k 

+ ^« E Eir + (^-^")EEir 

fe=rM+i i=i fc=o i=i 

r n 2k r n 2k 

= m + XM E Eir + (^-^-)EE ' 



QM, 



that is, 



r n ^2k 



(5-6) / + ^EEir = ^^^' 

k=0 j=l 

where qm is a s.o.s. polynomial, the desired result. □ 

(ii) Let M be as in (i) above. Evaluating (|5.4|1 at x = 0, and writing 
/(O) = /(O) - /* + /*, yields 

/(O) -/* + /*- (7M - nAA/e^') = qM(0) + uAm (e^' - 1), 



A SUM OF SQUARES APPROXIMATION OF NONNEGATIVE POLYNOMIALS 13 



and as 1/M > f* - {jm - nXMe^ ), 

1/M + /(o) - r 

^ n (eM^ - 1) • 

Now, letting M ^ oo, yields Xm ^ 0- 

Now, let e > be fixed, arbitrary. There is some M > Mq such that 
Aa/ < e in (|5.5|) . Therefore, (|4.2j) is just (|5.(ij) with A := e > \m and 
r = Te > tm- Finally, from this, we immediately have 

n oo 



< e^5^^ = ene^O, as e i 0. 

□ 



k\ 

i=l k=0 



6. Appendix 

In this section we derive two auxiliary results that are helpful in the proofs 
of Theorem 13.31 and Theorem 14.11 in ^ 

Lemma 6.1. Let n = 2 and let y be a sequence indexed in the basis \2.1\) . 
and such that Mr{y) >: 0. Then all the diagonal entries of Mr{y) are 
bounded by := maxfc=i,...,r max [y2k,o, yo,2k] ■ 

Proof. It suffices to prove that all the entries y2a,2/3 with |a + /3| = r are 
bounded by Sr ■= max [y2r,0) 2/o,2r], and repeat the argument for entries 
y2a,2/3 with la + /9| = r — 1, r — 2, etc ... Then, take Tr := maxfc=i^.,,^r Sk- So, 
consider the odd case r = 2p + 1, and the even case r = 2p. 

- The odd case r = 2p + 1. Let T := {(2a, 2(3) \ a + (3 = r, a ^ 0}, and 
notice that 

r = {(2r -2k,2k)\ A; = 1, . . . , r - 1} = Ti U Fa 

with 

Fi := {{r,0) + {r-2k,2k),\ k=l,...,p}, 

and 

F2 :={(0,r) + (2i,r-2i),| j = l,...,p}. 

Therefore, consider the two rows (and columns) corresponding to the indices 
(r, 0) and (r — 2k, 2k), or (0,r) and {2j,r — 2j). In view of Mr{y) t: 0, one 
has 

y2r,0 X y2r-4fc,4fc > {y2r-2k,2k)'^ , k = 1,... ,p, 

y0,2r X y4j,2r-4j > iy2j,2r-2j)'^ , j = l,...,p. 

Thus, let s := max {7/20,2/3 1 a+/5 = r,a ^ 0}, so that either s = y2r-2k*,2k* 
for some 1 < k* < p, or s = y2j*,2r-2j* for some 1 < j* < p. But then, in 
view of (|6.1I) . and with Sr ■= max [|/2r,0j yo,2r]; 

Sr X S > y2rfl X y2r-4k*,4k* > (y2r-2fc* ,2fc* )^ = •S^, 

or, 

Sr X S> yo,2r X y4j*,2r-4j* > {y2j* ,2r-2j*)'^ = s'^ , 
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SO that s < Sr, the desired result. 

- The even case r = 2p. Again, the set T := {{2a, 2/3) | a + /3 = r, a / 0} 
can be written F = Fi U with 

Ti := {(r,0) + (r-2A;,2A;),| k = l,...,p}, 

and 

T2:={{0,r) + {2j,r-2j),\ j = l,...,p}. 

The only difference with the odd case is that Fi n r2 = ip,p) / 0. But the 
rest of the proof is the same as in the odd case. □ 

Lemma 6.2. Let r £ 'N be fixed, and let y be a sequence such that the 
associated moment matrix Mr{y) is positive semidefinite, i.e., Mr{y) ^ 0. 
Assume that there is some G M such that the diagonal elements {y2fc} 
satisfy ^2*2 — '^r, for all k = 1, . . . ,r, and all i = 1, . . . ,n. 

Then, the diagonal elements of Mr{y) are all bounded by Tr (i.e., y2a < 
for all a £ N", with \a\ <r). 

Proof. The proof is by induction on the the number n of variables. By our 
assumption it is true for n = 1, and by Lemma |6.11 it is true for n = 2. 
Thus, suppose it is true for A: = 1, 2, . . . , n — 1 variables and consider the 
case of n variables (with n > 3). 

By our induction hypothesis, it is true for all elements y2a where at least 
one index, say Oj, is zero (oj = 0). Indeed, the submatrix A^\y) of Ar{y), 
obtained from Ar{y) by deleting all rows and columns corresponding to 
indices a S in the basis 1)2. II) . with Oj > 0, is a moment matrix of order 
r, with n — 1 variables x\ , . . . , Xi—\ , Xi-\-\ , . . . , Xfi . Hence, by a permutation 
of rows and columns, we can write 

' A^\y) I B 
Ar{y) = - I - 
B' I C 

for some appropriate matrices B and C . In particular, all elements y2a with 
ai = 0, are diagonal elements of ^r*^(y). In addition, its diagonal elements 

y2k^ i ^' bounded by r^. And of course, A^\y) ^ 0. Therefore, by 

our induction hypothesis, all its diagonal elements are bounded by r^. As 
i was arbitrary, we conclude that all elements y2« with at least one index 
being zero, are all bounded by Tt. 

We next prove it is true for an arbitrary element ?/2a with \a\ < r and 
a > 0, i.e., Oj > 1 for all j = 1, . . . , n. With no loss of generality, we assume 
that ai < 02 < . . . < On • 

Consider the two elements y2«i,o,/3 and yo,2a2,7) with /?, 7 € N"~^ such 
that: 

\P\ = \a\ — 2ai; I7I = |a| — 2a2, 

and 

(2ai,0,/3) + (0,2a2,7) = (2qi, 2a2, + 7) = 2a. 
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So, for instance, take /3 = (/^s, /34, • • • , f3n), 7 = (73, 74, • • • , 7n), defined by 
(3 := (as + a2- ai,a4, ... , an), 7 := ("3 + "i - "2, "4, • • • , an)- 
By construction, we have 4ai + 2|/3| = 4^2 + 2|7| = 2\a\ < 2r, so that 
both y4ai,o,2p and ^0,402,27 ai'c diagonal elements of Mr(y) with at least one 
entry equal to 0. Hence, by the induction hypothesis, 

Z/4ai ,0,2/3 < Tr, 2/0,4q2,27 < Tr- 

Next, consider the two rows and columns indexed by (2ai, 0, P) and (0, 2a2, 7). 
The constraint Mr{y) t: clearly implies 

Tr > 2/401,0,2/3 X 2/0,4a2,27 > (y2ai,2a2,/3+7)^ = ^la- 

Hence, 7/20; < Tr, the desired result. □ 
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